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1  \i  Qi 


APPROXIMATION  SCHEMES  FOR 


NONLINEAR  NEUTRAL  OPTIMAL  CONTROL  SYSTEMS 

by 

Karl  Kunisch 


Abstract :  - -  - 

We  discuss  methods  of  approximating  stable  neutral  functional 
differential  equations  and  associated  optimal  control  problems 
by  sequences  of  optimal  control  problems  for  ordinary  differen¬ 
tial  equations.  By  introducing  a  class  of  "mollified"  neutral 
functional  differential  equations,  convergence  of  the  linear 
interpolating  spline  and  the  averaging  approximation  scheme  is 
proved.  A  number  of  numerical  examples  is  included. 


approved  b*#n  and 

KotolMl  Offt,,, 


1 id. 


1.  Introduction  and  Notation. 


In  recent  years  a  significant  amount  of  research  was 
directed  towards  developing  approximation  schemes  for  delay  dif¬ 
ferential  equations.  Although  quite  a  few  attempts  have  been 
made  before,  a  paper  by  Banks  and  Burns  [2]  is  probably  the  first 
one  that  contains  convergence  proofs  (in  a  functional  analysis 
setting)  for  a  specific  scheme  -  called  averaging  approximations 
-  as  well  as  numerical  results.  Various  different  schemes,  most 
important  spline  approximation  schemes,  have  been  discussed  in 
the  meantime  and  we  refer  to  [1,2,3,20].  For  neutral  functional 
differential  equations  (NFDE)  the  author’s  papers  [15]  and  [7] 
are  probably  one  of  the  first  contributions  to  this  field.  Sub¬ 
sequently  in  [  9  ]  and  [11] spline  schemes  and  the  averaging 
approximation  scheme  have  been  discussed  in  different  state 
spaces.  For  a  treatment  of  a  certain  class  of  NFDE' s  that  can 
be  transformed  to  functional  differential  equations  (FDE)  we 
mention  [18]. 

In  this  paper  we  address  the  question  of  numerical  approxi¬ 
mation  methods  for  optimal  control  problems  associated  with  non¬ 
linear  NFDE  and  we  restrict  our  attention  to  the  averaging  or(  what 
is  almost  equivalent,  to  interpolating  linear  spline  schemes,  Al¬ 
though  one  might  suspect  that  these  schemes  converge  less  quickly 
than  higher  order  schemes,  the  extreme  simplicity  of  their 
algebraic  structure  and  the  resulting  simplicity  in  computer 


programming  is  a  persuasive  reason  for  their  investigation. 

Due  to  lack  of  high-order  smoothness  (averaging  approximation  subspaces 
consist,  roughly  speaking,  of  L  functions  and  linear  inter- 

1  oo 

polating  splines  are  W  *  functions),  however,  it  requires  much 
more  tedious  analysis  to  verify  convergence  of  these  latter 
schemes  than  for  schemes  whose  approximating  subspaces  consist 
of  functions  of  higher  order  smoothness  [4] . 

The  convergence  result  that  is  discussed  in  this  paper 
generalizes  the  one  in  [15]  in  that  it  is  uniform  in  the  control 
function  that  enters  into  the  right  hand  side  of  the  equation 
and  it  extends  [9,11]  in  that  these  latter  papers  treat  only 
linear  NFDE.  The  presentation  is  organized  in  the  following  way. 
Section  2  contains  the  existence -uniqueness  theory  that  will  be 
relevant  for  the  rest  of  the  paper  and  introduces  the  "mollified 
NFDE".  In  Section  3  we  first  discuss  an  approximation  result 
for  nonlinear  FDE  which  generalizes  those  existing  in  the  litera¬ 
ture  in  that  it  allows  nonlinear  point  delays  and  subsequently 
we  apply  this  result  to  the  mollified  NFDE  to  prove  the  above- 
mentioned  convergence  result  for  NFDE.  Section  4  finally  con¬ 
tains  a  discussion  of  a  class  of  optimal  control  problems  and 
examples . 

Throughout  the  paper  we  shall  employ  the  following  notation. 
The  n-dimensional  Euclidean  space  is  denoted  by  JRn  and  it  is 
endowed  with  the  Euclidean  norm  unless  specified  otherwise.  The 


3. 


set  of  all  nonnegative  real  numbers  is  1R+.  For  -«<a<b«» 
the  space  of  all  continuous  functions  x:[a,b]  -*■  ]Rn  is  denoted 
by  C(a,b;Rn)  and  is  endowed  with  the  suprenum  norm  ||x|| 

We  let  Lp(a,b;3Rn),  1  <  p  <  »,  stand  for  the  Banach  space  of 
all  equivalence  classes  of  functions  x:(a,b)  -*•  lRn  such  that 
|x|P  is  integrable  and  denote  the  usual  norm  by  |  ■  | 

There  will  arise  no  need  to  distinguish  between  representatives 
and  equivalence  classes  of  functions  in  Lp(a,b;Rn),  The  linear 
space  of  locally  integrable,  essentially  bounded  functions 
is  denoted  by  l“’^oc  (a,«°;lRn)  and  ,0°(a ,b  ^Rn)  stands  for  the 
Sobolov  space  of  absolutely  continuous  functions  with  derivative 
in  L<”(a,b  ;Rn) .  For  C(-r,0;lRn),  r  >  0,  we  simply  write  C 
with  norm  |  •  | ;  analogously  Lp  *  Lp(-r,0pRn)  and 
W1,0°  -  W1’"(-r,0ilRn) .  We  shall  also  need  the  space  of  continuous 
functions  x:[a,b]  -*■  C  abbreviated  by  C(a,b;C)  and  endowed 
with  suprenum  norm  ||  •  ||  ^a  The  restriction  of  a  function 

$  to  a  subset  J  of  its  domain  is  denoted  by  <|>|J.  We  let 

m  stand  for  the  vector  space  of  all  real  n  x  m  matrices  and 
A*  will  be  the  transpose  of  A  €  Finally,  as  usual  in  the 

theory  of  delay  equations,  for  r  >  0,  a  >  Oand  x:[-r,a]  -*•  lRn  the 
function  xt  is  defined  by  xt(s)  =  x(t+s)  for  s  €  [-r,0].  Some  familiarity 
with  the  basic  concepts  of  spline  analysis  is  assumed;  as  a  reference 
we  cite  [19].  The  reader,  who  is  unfamiliar  with  delay  equations, 
is  referred  to  [8] . 


j^D(xt)  =  £(t,xt,u(t)),  for  t  >  tQ 

xt  =  <M  €  C 
Z0 


(2.1) 


where 


S, 

DCip)  =  *(0)  -  l  B.  t|^(-r . ) ,  for  il>  6  C  (2.2) 

i=l  1  1 


with  0  <  r^. . .  <  rfc  *  r ,  €  n  an<*  Dom(f)  “  [t0,~)  x  c  x  IRm* 

A  function  x(*;<J>,u)  or  x(-;4>)  or  simply  x  will  be  called  a 
solution  of  (2.1)  on  [tQ-r,T],  T  >  tQ,  if  xt  =  <{>  and 


l  l  rt 

x(t)  =  <K0)  -  l  B.<K-r.)  +  X  B.x(t>r.)  +  f(s,x  ,u(s))ds  (2.3) 

i<  1  1  i-i  1  1  \  5 


holds  for  t  €  [tQ,T] .  The  following  conditions  on  f  will  be 
used: 


(HI)  For  all  a  >  tQ,  x  €  C(t0-r,a;Rn)  and  u  6  Lp(t0,a;lRm), 
the  mapping  s  -*■  f(s,x  ,u(s))  from  [tg,a)  lRn  is 
integrable ; 


5. 


(H2)  for  all  g  >  0  there  exists  a  nondecreasing  function 
nf  e  L“*loc(t0,»jlR+)  such  that 

I  f  ( t  *  » u)  -  f(t,ij>,u)|  <  nj(t)  (l+|u|p/2) 

for  all  t  €  [t0, and  i|>  e  C  with  |  <{>  |  <  g, 

| \i> |  _<  g  and  u  elRm; 

(H3)  there  exists  a  nondecreasing  function  n2  e  L°°,‘*'ocCt0 
such  that 

|  f  (t  ,4>  ,u)  |  <  n2(t)(l+|u|p/Z)(|<|>|+l)  , 

for  all  t  €  [t0,«) ,  <|»  e  C  and  u  e  lRm. 

Remark  2.1.  By  a  simple  calculation  one  can  verify  that  (H3) 
will  be  satisfied  ,  e.g.,  if  (H2)  holds  and  if 

(a)  there  exists  a  f  E  C  and  n^  e  L°°,loc (t^ ,« *IR+) 
such  that  |f(t,$,u)|  _<  n^  (t)  (1+ 1  u| p^2) ,  and 

(g)  there  exists  n2  e  Lm,loc(t0  ,»iIR+)  such  that 
I  f (t,4> ,u)  |  <  n2(t) (l+|u|p/2)  (Ul+1)  for  all 
t  €  [t0,«),  u  6  ]Rm  and  all  |$|  sufficiently  large. 

Remark  2.2.  Conditions  (HI)  -  (H3)  are  comparable  to  conditions 
(Hi)  -  (Hiii)  in  [1].  The  conditions  in  [1]  include  initial  data 


in  \?  (-r  ,0  ;JRn) ,  and  linear  discrete  delays  but  restrict  the 
class  of  nonlinear  functions  f  to  those  arising  from  distributed 
delays.  The  conditions  used  in  this  paper  include  nonlinear  dis¬ 
crete  delay  terms. 

Remark  2.3.  The  most  frequently  cited  class  of  examples  for  NFDE 
is  the  one  arising  from  certain  hyperbolic  partial  differential 
equations  modelling  lossless  transmission  lines  [6,10].  In  this 
case  f  =  fj  +  f 2 ,  where  fj  is  linear  and  f£  is  of  the  form 
f2(<j>)  =  ^2 +<^‘r^  describing  the  characteristic  curve  of  a 
diode.  So  there  is  a  reasonably  large  class  of  examples  to  which 
our  theory  applies. 

Lemma  2.1.  If  (HI)  -  (H3)  hold,  if  <j>  €  C  and  if  U  is  a  bounded 
set  in  Lp(tQ  ,T;lRm)  for  some  T  >  tQ,  then 

(LI)  there  exists  a  unique  solution  x(*;<j>,u)  €  C(-r+tQ ,T pRn) 
of  (2.1)  for  each  u  £  U  and 

(L2)  the  family  of  functions  {x(*;$»u)|u  €  U)  is  a  bounded 
set  in  C(tQ-r ,T;Rn) . 

We  shall  not  give  the  proof  of  this  lemma  here,  since  it  only 
involves  a  standard  Piccard- iteration .technique.  (L2)  follows 
easily  from  (H3) . 
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We  turn  to  the  following  "mollified"  form  of  (2,1)  and 
define  for  e  >  0 

x(t)  -  4>(0)  -  l  \  [  B.^s-rjds  +  l  \  f  B,x(s-r.+t)ds  +  f  f(s,x  ,u(s))ds. 

i“l  J°  1=1  K 

(2.4) 


Solutions  xe(*;J>»u)  or  xe(*;4>)  or  simply  xe  of  (2.4)  on 
[tn-r,T)  are  functions  satisfying  (2.4)  with  xE  *  <j>. 

Lemma  2.2.  Let  T  >  ,  <f>  €  C ,  let  U  be  a  bounded  set  in 

Lp(t0,T+l*dRm)  and  assume  that  (LI),  (HI)  and  (H2)  hold.  Then 

(a)  there  exists  a  unique  solution  xe(*;<t>,u)  of  (2.4) 
on  [t0-r,TE],  with  Te  >  T  for  all  sufficiently 
small  e  and  all  u  6  U. 

(b)  If,  moreover,  (L2)  holds,  then 

lim  xe  (t  ;<J>  ,u)  =  x(t;<|>,u) 
e+0 

uniformly  in  t  6  [t0,T]  and  u  €  U. 

Proof.  Parts  (a)  and  (b)  will  be  proved  simultaneously.  Let 

*(•;<!>, u)  a  x(»)  be  the  solution  of  (2.1)  on  [tQ-r,T]  for  some 

u  €  U,  let  eQ  <  r,  and  y  =  sup  ||x(*;t»u)||  ,  .. 

u  1  U€U  vz0  r,1J 

a  €  [tQ ,t0+min(r1-e0 ,T-tQ) ]  we  define 

9*  -  {z|z  €  C(t0,aORn),  IUII  [t  J  <  y  +  1> 


For 


U  .III  U 1U*.  IWl<n««MWlHOTni<nM|H«|iip|| 


and  for  e€(0,eQ)  and  t  e  [t0,a]  we  let 


(Ve2)(t)  = 

<0(0)  +  j  l  f  B- (Jfs+t-tg-r.) 

e  i-1  h  1  u  1 

-  <j>(s-r.))ds  +  f  f(s,z  >u(s))ds 

jto 

,(j)(s)  for 

s  e  [-r,0] 

where 

♦(s)  =  J 

^  4> (0 )  for 

s  e  [o ,») 

,z(s)  for 

s  e  [tg,a) 

and 

z(s)  =  | 

• 

4* (s ■  1 0 )  for  s  e  [t0-r,t0] 


I 


Obviously  Ve(^a)  e  C  (tQ  ,ajIRn)  .  We  shall  verify  Ve(.0a)  c  gp 
and  that  Ve  is  a  contraction  for  some  a  >  tQ,  For  z  ,w  e  cga 
and  t  €  [ tg ,a]  it  follows  from  (H2)  that 


r  t 

I  (Vez)  (t)  -  (Vew)(t)|  <  |f(s,zs,uCs))  -  f(s,ws,u(.s))|ds  < 

Jto 

A  ^ 

ll|z-w||  [t0,t]  ni+1^T)  ft  (l+|u(s)  |p/2)ds  < 

—  II  Z~W  II  [tg,t]  nl  1(T)  [(T"t0^1^2  +  I  U  I  P  *  [tg  »T]]  * 


(2.5) 


where  the  right  hand  side  of  (2.5)  is  independent  of  e,  for  0  <  e  <  eg 


^  Tiihi-inii  II 
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We  let  x  be  a  solution  of  (2.1)  and  use  (H2)  once  again  to 
find 


|(V£z)(t)|  <|x(t)|  +  |  (Vez)  (t)-x(t)  |  < 


+  'i-1  ll0Bi(-<,>^S'ri^"<l>(-‘ri)-)dsl  +  |t  lf(s>Vu(s))  -  f(s,xs,u(s))|ds  < 

£  y  +  2.^  ||B.||  p0(e)  +  2n}+1(T)  (y+1)  (t-tQ) 1/2  [  (T-tQ) 1/2  +|u|^t  T]] ,  (2.6) 


where  PQ  denotes  the  modulus  of  continuity  of  x(-)  on  [-r+tQ,T] .  Estimates 
(2.5)  and  (2.6)  imply  the  existence  of  solutions  x  (*;^,u)  on 
[tg-r,0^]  for  some  >  tg  and  all  u  €  U.  By  (H2)  and  an 

estimate  using  the  Gronwall  lemma,  it  also  follows  that 


lim  xe(t;<(>,u)  =  x(t;<}>,u)  (2.7) 

e  +  o 

uniformly  on  [tg,a^]  and  uniformly  in  u  6  U.  Using  the  uniformities  in  t 
and  u  in  inequalities  (2.5)  and  (2.6)  we  may  now  proceed  stepwise  with  step- 
size  -  tg  in  each  step  decreasing  the  range  of  e,  if  necessary,  to 
bound  the  underlined  term  in  the  estimate  of  Vez  by  an  additional 


use  of  the  triangle  inequality  and  the  fact  that  (2.7)  holds  on 
all  previous  intervals.  This  concludes  the  proof.  IS 
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The  last  lemma  of  this  section  will  be  of  importance  for  the 
approximation  of  optimal  control  problems  associated  with  (2.1). 

We  shall  need  an  additional  hypothesis: 

(H4)  Conditions  (H1)-(H3)  hold  with  p  =  2  and 

f (t,<{>,u)  =  f^(t,<|>)  +  f2(t,<t>)u;  moreover  for  all 
a  >  tQ  and  x  £  C(t0-r ,a  jlRn) ,  the  map 

--  t  f2(t’xt)  **  in~  lj2(t0»a;-^n,m)' 

As  usual-*  will  denote  weak  convergence. 

Lemma  2.3.  If  (HI)-  (H4)  hold  and  u^  -=»  u  in  (tQ  ,T  ;JRm) 
for  T  >  tQ,  then 


lim  x(t;<(),u  )  =  x(t;<f>,u) 
k->0 

uniformly  in  t  €  [tg,T]. 

Proof.  From  (H3)  it  follows  that  there  exists  g  >  0,  such 
that  |  xt(* ;  4>,u)|  <  g  and  |xt  ( • ;  4>>uk)  j  <  g  for  all  t  €  [tQ  ,T] 
and  k  =  1,2,...  .  By  (H2)  and  (H4)  we  get  for  t €  [tQ ,min(T ,tg+r^) ] 

|x(t;<J>,uk)  -  x(t;<j>,u)|  £  l|  (f(s,xs(<t>,uk)  ,uk(s))-f  (s,xs(<j>,u)  ,uk(s)))ds|  + 

Jto 

+  |f  (f(s,xs(<j>,u),uk(s))  -  f(s,xs(<j>,u) ,u(s)))ds|  < 


'f 


<  |  |f(s,xs(<j>,uk),uk(s))  -  f (s ,xg (ij) ,u) ,uk (s) ) | ds  +  |j  f2(s,xs(<J),u))(uk(s)-u(s))ds| 

Jto  Jto 

1  nJ(T)[(T-t0j1/2+  (|T  |uk(s)|2ds)1/2](jt  |xs(* ;*,u)-xs(- ;4»,uk) |: 2ds)1/2  +  p(k), 


where  lim  p(k)  =  0.  The  last  inequality  implies 
k-*» 


JxtC:;*»u)  -_xt(s<j>,u)|  < 


<  nf(T)[(T-t0)1/2  +  luk|2>[t  Tjjcf  |xs(.;4>,u)-xs(-;<?,uk)|2ds)1/2+p(k), 

*  ( y  t/\ 


so  that  by  an  application  of  a  generalized  Gronwall  lemma  and  since 
{uk|k=l,2. . . }  is  a  bounded  subset  of  L2 (tp rTdRm) ,  the  result  holds 
on  [tQ  ,min  (T.tQ+rj^)  ]  .  Again  in  a  finite  number  of  steps  we  reach  T. 
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3.  An  Approximation  Result  that  is  uniform  in  the  Control  Variable. 

In  this  section  we  shall  prove  convergence  of  an  approxima¬ 
tion  scheme  for  (2.1)  which  is  uniform  in  u,  as  u  varies  over 
a  bounded  set  U  in  L,P(t0  ,T;lRm) .  This  result  will  then  be 
used  in  Section  4  to  numerically  solve  optimal  control  problems 
associated  with  (2.1).  The  idea  is  to  approximate  (2.1)  by  the 
sequence  of  mollified  equations  (2.4),  and  then  to  use  techniques 
that  have  been  developed  for  the  approximation  of  FDE.  Of  course, 
passing  to  the  limit,  as  the  FDE  converges  to  the  NFDE  is  the 
major  difficulty  that  has  to  be  overcome. 

We  start  by  considering  the  FDE 

x(t)  *  f (t,xt,u(t)) ,  for  t  >  tQ 

(3.1) 

x  =  <J>,  with  <|>  €  C. 

T0 

In  many  instances  the  reformulation  of  (3.1)  as  a  Cauchy  problem 
in  a  function  space  over  the  delay  interval  has  proven  to  be  help¬ 
ful  [1,12  et  al].  For  the  space  C  this  has  been  studied  in  great 
detail  in  [13]  and  others.  It  is  the  variation  of  constants 
formula  of  this  abstract  Cauchy  problem  which  will  be  of  impor¬ 
tance  for  our  purposes.  Let  PC  =  PC(-r,0*En)  denote  the  space 
of  piecewise  continuous  functions  [ - r , 0 ]  -*■  ]Rn  endowed  with  the 
sup-norm  and  define  S(t):  PC  PC  by 


13. 


(SCtHHs) 


♦  (0) 

for 

<Kt+s) 

for 

s  >_  -t 
-r  <  s  <  -t 


and  Q0  :  [-r,0]  PC(-r,0;  by 


Q0(s) 


for 

for 


s  *  0 

-r  <  s  <  0. 


Consider  next  the  integral  equation  in  C  given  by 

xt  =  S(t-t0)<j>  +  J  S(t-s)Q0f(s,xs,u(s))ds,  for  t  >  tQ  (3.2) 

Jto 

where  the  integral  has  to  be  interpreted  pointwise  as  an  integral 
in  !Rn ,  i .  e . : 

S(t-s)(^f(s,xs,u(s))ds)(T)  =  j  (s(t-s)Q0j(r)f(s,xs,u(s))ds 

;to  t0  7 

for  r€[-r,0],  It  is  known. [12,  Proposition  2.1]  that  for  initial  data 
in  C  and  under  a  condition  that  is  weaker  than  (HI),  (3.1)  and 
(3.2)  are  equivalent  in  the  sense  that  x(t)  is  a  solution  of 
(3.1)  on  [tpiT]  if  and  only  if  xt  satisfies  (3.2).  The 
integral  equation  (3.2)  and  its  analogue  in  the  state-space 
]Rn  x  L2(-r,0dRn)  have  been  used  to  develop  various  different 
schemes  for  FDE  before  [1,2,4]  and  Theorem  3.1  below  is  a 
generalization  of  them  for  a  specific  class  of  schemes. 


14. 


Let  {tp,  j  =  0,...,N  be  a  partition  o£  ['r,0]  given 
by  tj  =  -  jjjj  and  define  the  corresponding  sequence  of  linear 
finite  dimensional  subspaces  of  C  by  =  {<|>€C|<J>  is  a 

linear  spline  with  knots  at  tp. 

A  basis  for  Z^  is  given  by  the  columns  of  =  (Bg»*  •  •  >Bjj)  * 
where  0^  is  a  matrix  whose  columns  are  in  Z^  and  for  which 


-  «4jI 


(3.30 


holds;  here  6^  is  the  Kronecker  symbol  and  I  is  the  identity 
matrix.  Of  course,  dim(Z^)  *  N+l  .  Next  we  introduce  some 
additional  notation.  The  families  of  operators  {Pp  and  (Ap 
from  C  into  zj  and  (Qp  from  [ - r ,0]  into  n  are  defined  by 


(Pp)  Up 


QjCs) 


for  j  *  0  ,  • • • ,N 


.  i° 

(  (l+Ss)I 


for  s  €  (-r  ,-t”] 
for  s  €  (-ty.O] 


, 


€  Z^  given  by 


*N(tp  -  -  4>(tp)  for  j  -  1,...,N 

<J>N(0)  -  0. 


with 
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Pj  and  act  as  interpolation  operators  onto ,  respectively  , 

into  Zj.  We  call  the  linear  interpolating  spline 

scheme  [4].  To  motivate  the  definition  of  we  recall  that 

S(t)  :C  ■*  C  is  a  linear  CQ-semigroup ,  whose  infinitesimal  generator, 
A,  is  given  by  Dom(A)  ■  1 4>  |  €  C*  (-r  ,0  jlRn)  ,  $(0)  =  0}  and 

""  •  jyt 

A  4>  =  4>  .  Since  A-/ ,  N  =  1,2,...,  are  bounded  linear  operators, 

A  ANt 

A1 L  N 

they  also  generate  linear  semigroups  e  that  we  denote  by  S^(t)« 
The  matrix  representation  [A^]  of  A^  restricted  to  Z^  is 
given  by 


where  <8>  denotes  the  Kronecker  product. 


Remark  3.1.  The  proofs  to  the  theorems  in  this  section  rely  quite 


[A?]t 


heavily  on  the  simple  structure  of  [A£]  and  e  A  .  For  higher 
order  splines,  for  example,  the  matrices  analogous  to  A^  become 
wider  and  wider  band  matrices,  whose  matrix-exponentials  seem 
quite  formidable. 
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In  the  following  lemma  we  state  some  of  the  properties  of 


AN  pN 
A1’F1 

and 

SN 

bl* 

Lemma 

3 .  r. 

(a) 

lim  P^<t>  =  <t>  for  all  <j>  €  C  , 

N  1 

(b) 

||PjH  i  1  for  all  N  , 

--  -- 

.(c) 

lim  S^(t)<}>  =  S(t)<{),  uniformly  in  t  on  compact 

N  1  ' 

subsets  of  [0,»), 

(d) 

||sj(t)||  <  1  for  all  N  , 

(e) 

■lim  (Sr?(t)Q^)  (s)  =  (S(t)Qft)  (s)  ,  uniformly  on 

N  1  u 

contact  subsets  of  [0,a]  x  t-r,0]  v  {(t,s)|t  =  -s},  for  any 

(£) 

11  Qi (s)  11  <  1  for  all  s  €  [-r,0]  and  all  N. 

The  proof  of  Lemma  3.1.  is  contained  in  [13,  pp.81]. 

(a),(b)  and  (f)  are  straightforward,  (c)  follows  from  the  Trotter- 

N 

Kato  theorem,  (d)  holds  since  the  logarithmic  norm  of  [A.]  is 

1  [AN]t 

zero  and  (e)  is  proved  by  using  the  special  structure  of  e 

Theorem  3.1.  Let  (HI)  -  (H3)  hold  and  assume  that  U  is  a 
bounded  subset  of  L^(tQ,T 0Rm)  and  T  >  tg.  Then  for  all  N 
sufficiently  large 

z(t)  -  sj(t-t0)pj*  ♦  Sj(t-s)(^f(s,z(s),u(s))ds  (3.5) 

*0 


v 


has  a  unique  solution  =  zN(*;<{>,u)  £  Z^  on  [tQ,T]  and 

lim  z^(t;<J>,u)  =  x  (*;<!> ,u^  in  C  (3.6) 

N  1 

uniformly  in  u  £  U  and  t  €  [tQ,T], 

Proof.  The  proof  of  this  theorem  is  contained  in  [16]  and  will 
only  f>e  outlined  here.  First,  it  was  verified  in  [13,  Lemma  B.2] 
that  the  integral  in  (3.5)  exists  as  a  Bochner  integral  and  that 

(S^(t-s)Qj)  (x)  f  (s  ,y  (s)  ,u(s)  )ds . 

Since  sjzj  c  zj  and  qJzJ  <=  zj  it  follows  immediately  that 

N 

the  trajectory  of  any  solution  of  (3.5)  must  lie  in  Z^. 

By  Lemma  2.1,  (L2),  the  family  {z(t,u)|t  €  [tQ,T]  and  u  £  U) 
is  contained  in  a  ball  of  radius  y,  0  <  y  <  °°  ,  in  C.  For  any 
a,  tg  <  a  <  T  we  define  the  set 

4a  ■  {*  €  C(t0,a;C)|  sup  |<l>(t)|  <  y  +  1), 

t€[t0,a] 

and  a  family  of  operators  V^:C(t0,o;C)  •+■  C(t0,a;C)  by 

CV*y)(t)  -  S?(t-t0)^  4  f*  sJ(t-s)Q5If(s,y(s),u(s))ds. 

Jto 


(3.7) 
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By  (H2)  and  Lemma  (3.1)  (d)  one  can  show  that  there  exists  a 
constant  C^,  independent  of  N  and  u  £U,  such  that  for 
all  t  €  [  t  q  ,a]  and  y,w  € 

lA(t)  -  Act)!  <  C.  sup  |y(t)  -  w(t)|(t-tn)1/2.  (3.8) 

"  1  te  [t0,a]  0 

Moreover,  there  exists  a  function  p  with  lim  p(N)  =  0  and  a 

•  --  -  .  .  .  _  .  N 

constant  C2,  both  independent  of  u  £  U  and  C2  not  depending 

on  N,  such  that  for  all  y  £  <2^  and  t  £  [tQ,a] 

|VNy(t)-z(t)|  <  p(N)+C2^x+X1/2+(t-t0)1/2+(J  |y(s)-z(s)|2dsj1/2 j  < 

Jto 

<  p(N)  +  C2(T+X1/2+2(t-t0)1/2(l+Y)).  (3.9) 

To  verify  (3.9)  one  uses  (3.2),  (3.7),  (H2) ,  (H3)  and  Lemma  3.1. 
Lemma  3.1.  (e)  specifically  implies  that  for  each  t  >  0  and 
X  >  0  there  exists  an  NQ  =  Nq(t,X)  such  that  |  (S^(t-s)Q^)  (0)  - 
(S(t-s)Qo)(0)|<  t  for  all  N>NQ,  t€[tg,T],0  €  [-r,0]  and  s  £  [tQ,t] 
(t-X+^t+X+9) . 

Estimates  (3.8)  and  (3.9)  imply  that  there  exist  Tq  >  0,  XQ  >  0  and 

“i’to  <  ai  <  T,  such  that  for  all  N  sufficiently  large 

VN<»  c  «  and  VN  is  a  contraction  on  «  ,  so  that  there 

al  al  al 

exist  unique  solutions  zN  of  (3.5)  on  [t^fo^J-.  For  t  £  [tg,^ 
equality  (3.6)  follows  from  the  first  inequality  of  (3.9)  with 
VNy(t)  =  y(t)  =  iN(t). 


We  now  notice  that  the  constants  in  the  estimates  (3.8)  and  (3.9)  are  actually 
uniform  in  t  €[tg,T].  Therefore,  one  can  proceed  stepwise  with 
constant  stepsize  -  tg,  each  time  repeating  the  above  argument 
until  T  is  reached.  This  concludes  the  proof,  ffl 

Remark  3.2.  Theorem  3.1.  remains  true,  if  (H3)  is  replaced  by 
assuming  Lemma  2.1  (L2)  and 

|f(t,0,u)|  <  n2(t)  (l  +  |u|p/2) ,  for  all  te[tQ,<»)  and  u  €  ]Rm. 

For  the  proof  of  Theorem  3.1  we  only  used  properties  of  the 
scheme  as  given  in  Lemma  3.1.,  so  that  this  theorem 
would  remain  valid  for  any  scheme  that  satisfies  Lemma  3.1. 


for  t  tQ 

and  assume 

(H5)  (i)  D<J>  =  <J>(0)  -  B<J>(-rj)  with  0  <  r^  <  r 

(ii)  p (B)  <1; 

here  p  denotes  the  spectral  radius  of  the  matrix  B  Ey 

n  ,n 
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Remark  3.3.  Condition  (H5)  is  not  as  strong  as  it  might  appear 
at  first,  and  is  directly  connected  with  stable  difference 
operators  as  discussed  in  [8,  chapter  12.5].  If  D  is  of  the 
specific  form  chosen  in  (H5)  (i) ,  then  it  is  stable  (stable  in 
the  delay  r^)  if  and  only  if  p(B)  <  1.  Note,  that  if  p(B)  <  1, 
then  there  always  exists  a  norm  | • |  on  lRn  and  a  subordinate 
matrix-norm  ||  •  ||  ,  such  that  ||B||  <1.  Throughout  the  rest 

of  this  chapter  it  is  assumed  that  lRn  is  endowed  with  this  norm. 

It  should  also  be  mentioned  that  those  NFDB  which  arise  when  trans¬ 
forming  certain  hyperbolic  partial  differential  equations  generally 
satisfy  p(B)  <  1  ,  [6] . 


1 


Remark  3.4.  Although  the  results  are  stated  for  the  case 

when  D  contains  only  one  discrete  delay,  they  are  easily 

generalized  to  several  delays  as  in  (2.2),  as  long  as  there  exists 

l 

some  norm  on  1R  such  that  l  ||  B  -  ||  <1  holds  for  the  sub- 

i=l  1 

ordinate  matrix  norms.  We  recall  that  in  the  scalar  case 
l 

l  || B-  ||  <1  is  necessary  and  sufficient  for  D  to  be  stable, 

i=l  1 
[8,  pp.291]. 

For  D  as  in  (H5)  the  mollified  equation  (2.4)  is  just  the 
variation  of  constants  formula  of 


x(t)  =  i-  B[x(t+e-r1)  -  x(t-r1)]  +  f(t,xt,u(t)) 

(3.10) 

x  =  d>  ,4>  €  C. 
c0 


21. 


By  Lemma  2.2  (a)  there  exists  an  such  that  (3.10)  has  a 

unique  solution  x£  =  xe(*;<i>>u)  for  all  e  with  0  <  e  <  <  r^ . 

Next  for  e  £  (0,e^]  consider  the  sequence  of  equations 


zN’£(t)  =  S^t-t^pJ*  +  j1  sJ,(t-s)(^f(s,zN»e(s),u(s))dS  + 

Jto 

+  f  S^t-s)^  |g(zN«e(s)(*+e)-zN'e(s)(.))ds 
.  Jto 

(3.11) 

l 

where  g(<f>)  =  B<#> ( - r , )  ,  (or  g(4>)  =  l  B.$(-r.)  in  case  of  multiple 

1  i=l  1  1 

discrete  delays  in  D) .  By  Theorem  3.1  there  exist  solutions 
zN ,e (•;<!> ,u)  of  (3.11)  for  sufficiently  large  N  and 

lim  zN,e(t;<|>,u)  =  xf(*;<t>>u).  (3.12) 

N  £ 


The  above  limit  holds  uniformly  in  t  £  [tQ,T]  and  u  £  U,  for  each 
fixed  e  €  (0  ,e^] . 


The  sequence  of  approximating  problems  whose  solutions 
(hopefully)  approximate  the  solution  of  (2.1)  finally  is  given  by 


zN(t)  =  sj(t-t0)p5y  +  J*  sJ(t-s)qJf(s,zN(s),u(s))ds  + 

Jto 

♦  P  s5I(t-s)(i,^B(zN(s)(tNN  )  -  zN(s)(tNJ)ds  (3,13) 

JtQ  1  1  r  jN-l  jN 


( 
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This  is  the  appropriate  form  of  using  the  scheme 

for  approximating  (2.1). 


Theorem  3.2.  Let  T  >  tp  and  let  U  be  a  bounded  set  in 
L^(t0  ,T*dRm)  .  Moreover,  assume  that  (HI)  -0)3)  and  (H5)  hold 
and  that  |jB|j  <  1  for  an  appropriate  norm  on  ]Rn.  Then  for 

<t>  £  W1’°o(-r,00Rn)  solutions  zN(t;<f),u)  of  (3.13)  exist  and 

lim  zN(t;<f>,u)  =  x  (-;4>,u)  (3.15) 

N  Z 

uniformly  in  u  €  U  and  t  €  [t0,T]. 

Proof.  First  we  need  some  additional  notation.  For  x  £  ]Rn^N+1^ , 

with  x  =  col  (xn , . . .  ,xM)  let  jjx||°°=  sup  | x -  |  and 
u  N  i=0,...N  1 

|| x H  °°  =  sup  |x.  |.  Since  the  trajectories  of  (3.11)  lie 

i=l , . . . ,N  1 

entirely  in  z^  it  follows  that  zN,e(t;<j>,u)  =  6Nv^»e(t)  uniquely 
defines  vN» e  (t ;  <p  ,u)  £]Rn(N+1\  for  t  €  [tQ  ,T]  . 

The  existence  of  solutions  zN(t;4>,u)  of  (3.14)  is  quite 
simple  to  verify  and  we  immediately  turn  to  (3.15)  and  choose 
n  >  0  arbitrarily.  By  Lemma  2.2(b)  it  follows  that  there  exists 
an  such  that 


i ( •  ;<J>,u)  -  xt(.;<j>,u)|  <  n 


(3.16) 
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This  is  the  appropriate  form  of  using  the  scheme 

for  approximating  (2.1). 


Theorem  3.2.  Let  T  >  tQ  and  let  U  be  a  bounded  set  in 
LP(tj)  ,T;lRm) .  Moreover,  assume  that  (HI)  -  (H3)  and  (H5)  hold 
and  that  ((&jj  <  1  for  an  appropriate  norm  on  lRn.  Then  for 

<j>  £  W1,oo(-r,00Rn)  solutions  zN(t;4>,u)  of  (3.13)  exist  and 

lim  zN(t ;  <t>,u)  =  x  (•;<{>, u)  (3.15) 

N  z 

uniformly  in  u  €  U  and  t  €  [t0,T]. 

Proof.  First  we  need  some  additional  notation.  For  x  £]Rn^N+^, 

with  x  =  col  (xQ , .  .  .  ,xN)  let  J|x||  °°  *  sup  | xi  |  and 

i=0  , .  .  .  N 

||x||  =  sup  | x -  ( -  Since  the  trajectories  of  (3.11)  lie 

i=l , . . . ,N  1 

entirely  in  it  follows  that  z^,G(t; 4>,u)  =  gNv^>e(t)  uniquely 

defines  v^,e(t;4>,u)  £]Rn*-N+1^,  for  t  £  [t^.T], 

The  existence  of  solutions  zN(t;ct>,u)  of  (3.14)  is  quite 
simple  to  verify  and  we  immediately  turn  to  (3.15)  and  choose 
n  >  0  arbitrarily.  By  Lemma  2.2(b)  it  follows  that  there  exists 
an  e2  <  such  that 


I ( •  ;<J>,u)  -  xt(.;$,u)|  _<  n 


(3.16) 
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for  all  e  <  e^,  u  £  U  and  t  €  [ tQ , T] .  We  shall  use  the  simple 
estimate 

||wN(t)-^’e(t)||  "<  sup(  ||wN(t)-vN»e(t)||  <”,,|wN(t)-wN(t)|+  ||wN(t)-vN’e(t)||  + 

+  |vj’e(t)-vjj»e(t)|). 

From  the  two  technical  Lemmas  3.2  and  3.3  at  the  end  of  this 
section  and  the  above  estimate,  it  follows  that  there  exist  constants 
Nq  and  0  <  such  that 

lzN’e(t;<M)  -  zN(t;^,u)|  (3.17) 

for  all  e  <  e3,  N  _>  NQ,  u  €  U  and  t  £  [t0,T].  Finally, 

(3.12),  (3.16)  and  (3.17)  imply  that  for  some  Nj  >_  NQ 
|z  (t;4>,u)-xt(*  ;4>,u)  |  _<  3n  for  all  N  >  ,  uniformly  in  t 

and  u.  This  ends  the  proof.  gg 

N 

Remark  3.5.  The  special  form  of  [A^]  was  used  in  the  proof  of 
Lemma  3.1  (e)  and  will  be  used  even  more  stringently  in  the 
proofs  of  Lemmas  3.2  and  3.3  below.  For  subspaces  Arising 

a* 

from  averaging  approximations  [2]  the  operators  approximating  A 

N 

turn  out  to  have  the  same  matrix  representation  as  A^,  when 
restricted  to  the  finite  dimensional  subspaces.  We  briefly  discuss 
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the  averaging  approximation  scheme.  The  state  space  is  chosen 
to  be  !Rn  x  LZ  (-r , 0 ;lRn) ,  and  will  be  abbreviated  by  Z  when 
endowed  with  its  natural  inner  product  and  resulting  norm. 

Z^  are  linear  subspaces  of  Z  defined  by  Z^„  =  {  (n»4>)|n  £lRn, 

aV  a  v 


av 


N 


,  a-  e  ]Rn},  where  is  the  characteristic  function 


N 


=  l  a,x, 

j  =  1  J  J 

of  the  interval  [t^.t1-'1  , ).  The  orthogonal  projections 

J  J  ~ 1 

Pav:Z  *  Zav  are  Siven  by  paV(n,<^  =  ^n»  *jXj)  with 


av 


av' 


<f> 


N 

tj-l 


j  N  <Ks)ds  for  j  *  1,...,N.  The  operators  corresponding 

to  are  defined  by  QaV(h,$)  s  (h,0),  independentlyof  N  and 

Aav:Z  *  1  are  given  by  Aav(n*  •^1ajxj')  =  {0,F  .^^j -l'aj)xj) 
with  aodlf0,  and  aJvz  «  A^P^z  for  z€Z.  {  Z^.P^.A^} 
is  called  the  averaging  approximation  scheme. 

For  linear  equations  with  f  of  the  form 


•s.  v  rO 

f  (n,<t>,u(t))  =  A()h  +  [  A.(J>  (-h.)  +  A(s)<j>(s)ds  +  Eu(t),  (3.18) 

u  i=l  1  1  *-x 


where  0  =  hQ  <  hx  <  . . .  <  h  v  =  r ,  Aj  €  ^>n, 
2 

an  L  -  n  x  n-  matrix- valued  function  and 
it  was  proved  in  [2]  that 


E£^n,m'  A(-> 

U  £  LP(t0,TiIRm), 


lim  z!Jv(t;n,<l>,u)  *  z(t;n,4>,u)  =  (x(t),xf)  in  Z  (3.19) 

N  av  t 

uniformly  in  t  €  [ t Q , T]  and  in  u,  as  u  varies  over  a  bounded 
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subset  of  Lp(t0  ,T;]Rn) .  Here  x  satisfies  =  f (x(t) ,xfc,u(t) )  , 

(x(tn)  ,x,.  )  =  (n » 4> ) ,  with  f  as  in  (3.18),  and  ^  ft)  = 
u  c0  v 

=  (wn(t),  l  w?Ct)x?)  where  w^(t)  €  ]Rn(N  +  l)  are  soiutions 
u  j*l  ]  -1 

of  the  ordinary  differential  equation 


wN(t)  =  [A^] wN(t)  +  col (f (zgV (t),u(t)),0,...,0) 

wN(t0)  55  colCn.^J,. .  .  ,*JJ)  where  Pav(n,4>)  =  (n,^  4jXyh 


Once  (3.19)  is  established  one  can  turn  to 


x ( t )  =  Bx(t-rx)  +  f(x(t) ,xt,u(t) ) 


(x(t0),Xt  )  *  (*(()),+),♦  e  c. 


(3.20) 


Only  a  few  changes  have  to  be  made  in  the  proof  of  Theorem  3.2. 
(we  notice  that  the  technical  Lemmas  3.1  and  3.2  remain  true, 
since  ItP^UtO),*)).  -  (p”vC*(0)  ,  *) ) .  n  |  .  0(i)  for 
i  *  0,...,N-1,  and  <j>  g  W^,co)  before  we  arrive  at: 

Proposition  3.1.  If  f  is  as  in  (3.18),  if  T  >  tQ,  $  e  w1 »°° 
and  if  U  is  a  bounded  subset  of  Lp(tQ  ,T.]Rm)  t  then 
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1jm  zav(t)  =  (*Ct),xt)  in  Z 


(3.21) 


uniformly  in  u  £  U  and  t  £  [tn,T].  Here  x  is  a  solution  of 


(3.20)  and  ^v(t)  >  “aVjl(t)x?),  »he 


re  "av  is 


the  solution  of 


av(t)  "  ^Jw?v(t>  +  +  ^(Wav,.N  1  (t)^av,  ,N(t)  > '°" ' 

wN(t0)  *  col(*(0),^,...,*jj)  where  pL(*(0),*)  =  (*(0),  £  A?). 

i=l 


.0) 


(3.22) 


Comparing  (3.14)  with  (3.22)  we  find  that  for  many  specific  NFDE 

the  approximating  ordinary  differential  equations  arising  from  the 

linear  interpolating  spline  scheme  and  the  averaging  approximation 

scheme  differ  only  with  respect  to  the  initial  value.  The  initial 

values  will  be  equal  if  <J>  is  constant,  for  example.  Proposition 

3.1.  can  be  extended  along  the  lines  of  Theorems  3.1  and  3.2  to 

include  nonlinear  equations,  if  conditions  analagous  to  (H1)-(H3) 

hold.  Since  the  techniques  are  rather  obvious  but  tedious,  we 

shall  not  include  the  details.  This  ends  Remark  3.5. 

We  conclude  this  section  with  the  two  lemmas  which  are  necessary 

for  the  proof  of  Theorem  3.2  and  recall  that  v^,e(t)  and  wN(t) 

are  the  coordinate  vectors  of  zN,e (t ; 4> ,u)  and  zN(t;<j»,u)  with 

N 

respect  to  the  basis  B  respectively. 
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Lemma  3.2.  Under  the  hypotheses  of  Theorem  3.1  there  exist 
constants  JC^,  i  =  depending  on  4>,f,B,T  and  U,  but 

not  depending  on  N,e,  t  and  $  such  that 

||wN(t)||  “  <  Kj  and  ||wN(t)ir  <K2kL  +  K3  +  K4|u(t)|P/2.  (3.23) 


If,  in  addition,  e  >  0  and  N  satisfy  ^  M  then 

l|vN’£(t)||  00  <  Ks  and  ||^’£||  °°  <  Kgl*  1^+  K?  +  Kg|u(t)|p/2  (3.24) 


with  |<|>|  =  ess  sup  U(t)|. 

t€[-r,0] 


Proof.  We  start  with  a  few  useful  technicalities  and  define 


z(s,i)  =  J77  (fCt-s))1  expf-^Ct-s))  for  i*0,...,N-l  and  t  >  s. 


The  following  estimates  can  be  found: 


Z(s,i)ds  <  1  for  i  =  0,...,N-1 


(3.25) 


V 
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and  1 

,  w  24  i 

Z^(s,i)ds  <  1N— g  ,  for  i=  0, . .  .,N-1 .  (3.26) 

'tQ  2r/iiT 


(3. 25) follows  by  a  simple  induction  argument  showing  Z(s,i)ds 

Jt„ 


1  ' 


N(t-t0)  -N 

- y -  exP  (— p-ft-tp)).  Another  induction  argument 


implies  that  [  Z2(s,i)ds  <  — - ^  •  .  t  »  anc*  (3.26)  now 

--  -  4  tQ  -  -  “  r  (i !  )Z2^1  1 

follows  by  Stirling's  formula.  From  [12,15]  we  use  the  explicit 

[A^ ( tl 1 

representation  of  el  1  ^  ^ J  given  by 


< 


,  N 


[A^t]  = 


[exp(^  c")-l](cVV 


exp  (^  CN) 


(3.27) 


N 

where  a  =  col (I ,0, . . . ,0)  and 


N 

By  employing  the  measure  of  the  logarithmic  norm  of  [A^]  it  is 
proved  in  [12,  Lemma  5.4]  that  for  each  x  =  (Xq,...,^)  £]Rn^N+1^ 
and  with  JRn  endowed  with  the  Euclidean  norm 


[3.28) 


A?t 


[e  1  lx  II"  £  ll*ir 


holds;  it  is  simple  to  check  that  endowing  !Rn  with  any  norm  does 
not  change  that  estimate. 

N 

To  verify  (3.24)  we  recall  the  definition  of  t  N  and  choose 
kN  =  kN(e)  such  that  e  -  r,  €  [t^M  w,tN 


jN-kN  jN-kN-l 


);  of  course, 


N 


it  is  still  assumed  that  e  <  <  r^.  The  choice  of  k  implies 


^  a„d  I^-Jl  <  £,. 


(3.29) 


From  (3.11),  (3.28)  and  (3.29)  it  follows  that 


il vN,e(t) ||  "  <  |pJ*|  +  |  |f(s,zN,e(s),u(s))|ds  + 

Jto 

+  tf  r  B  col(I,(l-o(l,t-s))I,...,(l-o(N,t-s))I)(vN»e  (s)-vN’e(s))ds| 

e  j  -k  j 


where  o(j,s)  =  expC^)''  l  (k)  (^) X  for  X  -  1 . N.  By  (H3) 

r  X=0  '  r 

the  last  estimate  implies 

||vN,el!  “  1  |P$V|  +  Jt  n2(s)(  llvN,e(s)||  *  *l)(Hu(s)|P/2)ds  +  ||R(t)  ||  ", 


where  we  yet  have  to  find  bounds  on  the  coordinates  of  R(t) . 
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iv‘)i  *ii&  r  l  M  < 

Jto  „=jN-kNn 

iJl^r  kNcilvN,*ct)ir  *  ||  vN,e(t0) ||  * )  < 

<  II  B  II  (1*%)CI|VN-C(t)|r  *  II  V1**  (t„)||  "  )  ; 


here  we  used  (3.29). 

Similarly  for  i  ■  1,...,N  one  finds 


t  i-1  -N 

[l-«pC>-s))  j  jf(£)x(t-s)x]  1  vR-'(s)ds|  = 

Jt0  X=0  ykV+l 

jN  t 

•!|  £  „  [(o(i,t-t0)-l)vR’£(t0)] ♦  |  Z(s,i-l)vR’£(s)d8|  < 

y=kN-jN+l  *0 

1JlBU_rlc^  [||vN’e(t0)|r  ♦  J*  Z(s,i-1)  vN>e(s)|rds]  < 

t0 

i  l|B||  (l*a,)(l|vN’£(t0)||"  *  f  Z(s,i-1)  ||vN’£W||"ds). 

;to 

By  hypothesis  on  e  and  N,  we  have  that  1  -  ||b||  "ejj  —  )» 

II B||  (1+^)  <.  1,  and  therefore  after  summarizing  the  above  estimates 
one  arrives  at 

||vN’er<2(l-  ||B||)-1[|pf*|  +  f*  n2(s)(l+|u(s)|p/2)ds  +  || /’e(t0)  II"  + 

tn 
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+  max  I1  (Z(s,i-1)  +  n?(s)(l+|u(s)|p/2))  ||^’e(s)||  “dsl  < 
i=l,...,N  tQ 

<  2(1-  || B|j  ) ' 1 12 1 $ |  +  J*  n2(s)(l+|u(s)|P/2)ds  + 

% 

+  max  f  (Z(s,i-l)+n2(s)(l+|u(s)|p/2))  ||vN,e(s)H  “dsl; 


aiv  application  of  Gronwall's  inequality  now  implies  the  result.  For  the 
estimate  of  ||vN»  e(t)||  "  one  uses  (3.11),  (3.27)  and  (3.28), 
so  that  for  t  €  [t0,T] 


ll^,£Ct)ir  i  ||£col(0,(vN»e(t0)  -  vN’e(t0))I,...,(vjj’J(t0)  -  vJj’Eft0))I|| 


-N(t-S) 


_ t  (n  „  r  T  1  ^(t-s^N-l 

col  ^0  ,e  I , . . .  >7j^rjT|  C  f  ) 


-N(t-s) 


0 


[fCs,zN,e(s),u(s))  *  |  B(v^€  N(s)  -  i^E(s))]ds||  *  . 

j  j 


+  |f(t,zN,e(t),u(t))|  +  ||  B(v^N(t)  -  v^e(t))|. 

N 

Recall  that  B^(t^)  =  gN  v^,e(tn).  Since  by  assumption  4.  €  W1’", 

1  j=0  J  J  u 

the  last  estimate  together  with  (H3),  (3.25) and  the  previously  determined 
bound  on  z^,c(t)  (or  equivalently  v^,e(t))  imply 


n2(s)(l+|u(s)|p/2)(l+K5)ds  +n2(t)(l+|u(t)|p/2)(K5+l)  + 


'/ 


IIJ  col(°*e  r  e  r 

*o  3  3 


+  Ifbc^V«  -  vNn£^I- 

3  "K  3 


(3.30) 


It  is  in  this  estimate  that  <*>  €  W1 ,0°  is  needed  essentially. 

By  (3.10)  the  coefficient  vectors  vN,E  (t)  satisfy 

v^’e(t)  =  [A^]vN’e(t)  +  [QjljfCt^^fO.uft))  +  |B(v^»®  (t)-v^e(t))|,  (3-31) 

3  3 


which  implies  that  v^’E(t)  *  p(v^lf(t)  -  v^»E(t))  for  i  =  1,...,N. 
Therefore 


N(t)-vN^Ct))|  <  fcN  ||^’e(t)ir  <  ||B||  a^)IKN’e(t)||". 

3  “*■  3 

Hie  fourth  term  IV  in  (3. 30)  is  estimated  separately  now.  A  short  calculation 


shows 


(Wji  <  k5  <  3x5 . 


And  for  i  ■  2 , . . . ,N  we  get 

,N  t  /  \  i-1  'Nfl-s) 

iwd  -  US  1  N  N  J  rrnrN1  •  r  ^N’e(s)ds' 

y-  j-r+l  Z0  \  / 
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-  -^|r^  I  [l|vN,e(t0)||  “  ♦  f  (Z(s,i-2)  +  Z(s,i-1))  ||vN’e(s)||  -ds] 

p-jV+l  Jto 

3  ||  B  ||  rkNK5 

1 - Efl - 1  i  6K5- 

Using  these  last  estimates  in  (3.  30)  we  arrive  at 
||^’e<t)|r  <  2(1- ||B||  >_1[6K5  +  lil,  +  C  n2(s)(l+|u(s)|p/Z)(K5+l)ds  + 

Jtb 

+  (K5+l)  n2(t)(l+|u(t)|p/2)]  , 

so  that  (3.24)  is  established.  The  proof  of  (3.23),  similar  to  the  one 
for  (3.24),  is  contained  in  [15]  and  will  therefore  not  be  given  here. 

Lemma  3.3.  Under  the  hypotheses  of  Theorem  3.2  and  the  additional 
condition  that  ^  <_  ^  2^'^  ’  there  exist  constants  depend¬ 

ing  on  <j>, f , B , T  and  U  but  independent  of  <j>,N,e,t  such  that 

|v£’e(t)  -  v“'*(t)|  <  )»L 

lwo(t)  -  wj(t)|  .<  1 4*  1^  M3  £ 

||vN*e(t)  -  wN(t)  ||  <  (f^ 


M.  ~  +  M_  — 
1  N  2  ^ 


+  M . 


/N 


(3.32) 

(3.33) 


+l)Mc(e  +  4)  +  m6  ^ 


,/n 


(3.34) 
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Proof.  From  (3.11),  (3.24),  (3.27)  and  (H3)  it  follows  that 

(t-t  ) 

|vg'E(t)  -  vj’£(t)l  <  I  6  r  0  ((pj*)0  -  (pj^pl  + 


+  IJ  e  r  (f(s,zN*e(s),u(s))  +  \  B(vN^e  N(s)  -  vY(s)))|  < 
Jtn  j  j 


-N(t-s) 


£  l<H0)  -  0»(tj)|  +  |  e  r  n2(s)(l+|u(s)|p/2)(  ||vN»e(s)||  “  +  l)ds  + 
iN  ft  -NCt-s) 

+  \\$  l  |  e  r  v^e(s)ds|  < 

y=jN-kN+l  Jt0  " 

<  J  l*L  +  (V1)n2(t)  (2R)1/2(f^  Iu(s)|pds)1/2y 

*?IIbIIn^[(I*I-Vk7)J  +  V§n)1/2(C  • 

fco 

By  (3.29)  and  since  ^  <  1  it  follows  that  <  2,  which 


can  be  used  in  the  last  estimate  to  imply  (3.32).  The  proof  of 

(3.33)  is  quite  similar.  Employing  (3.26)  the  second  estimate 

in  (3.29)  and  (3.31)  the  verification  of  (3.34)  is  somewhat  tedious, 
but  simple, and  will  not  be  given  here,  see  [16].  Estimates  (3.32)- 

(3.34)  imply  (3.34)  with  ||  *  |j  replaced  by  ||  •  ||  ;  we  were 

not  able  to  prove  (3.34)  directly. 


In  this  section  the  theory  that  has  been  developed  in  the 
previous  section  will  be  applied  to  optimal  control  problems 
associated  with  (NFDE) . 

We  restrict  ourselves  to  a  simple  class  of  problems  and  re¬ 
fer  to  [1],  [16]  for  a  more  elaborate  discussion  on  the  type  of 

problems,  specifically  cost  functionals,  that  can  be  treated  within 
the  same  framework.  The  aim  of  this  section  is  to  demonstrate 
the  feasibility  of  using  the  linear  interpolating  spline  and  the 
averaging  approximation  scheme  for  actual  computations  and  to  report 
on  some  examples. 

The  equation  under  consideration  is  (2.1)  and  (2.2)  again 

and  in  view  of  Remark  3.3  we  assume  that  lRn  is  endowed  with  a 

* 

norm  such  that  l  j  j  B  -  | |  <  1.  The  controls  will  be  taken  from 

i  =  l 

a  closed  and  convex  subset  U  of  L^ft^ ,TdRm) .  Below  we  shall 

N  N  N 

continue  to  give  the  details  for  the  {  Zj,P^,A^}  scheme  and  we 
only  mention  that  in  continuation  of  Remark  3.4  and  Proposition  3.1 
one  may  derive  similar  results  for  the  averaging  approximation  scheme. 

We  define  a  functional  J:  ]Rn  *  C  *  C(tg,T;IRn)  *  (t^  ,T^IRm)-»- R 

by 

r°  * 

J(yi,y2,y3,y4)  -  (y1-«0))*G(y1-5(0))  +  (y2(s)-C(s))  H(y2(s)-£(s))ds  + 

'  -r 
T 

+  |  [y3(s)*Qy3(s)  +  y4(s)*Ry4(s)]ds  (4.1) 

*0 

where  5  €  C  is  fixed  and  G,h,Q  and  R  are  semi-definite, 
symmetric  matrices  of  appropriate  dimensions.  R  moreover  is 
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positive  definite.  The  cost  functional  <t>  :  kP(tQ,T;IR  )  -►  1R 
is  given  by 

I 

4>(u)  =  J(x(T;<}>  ,u) ,  xT C *  ;4>  »u)  ,  x( •  ;<j>  ,u)  ,u) 

where  x(*;<|>,u)  is  a  solution  of  (2.1).  Now  an  optimal  control 
problem  can  be  formulated: 

(P)  Minimize  <P  (u)  over  U. 

Analogously  we  define  a  sequence  of  approximating  optimal  control 
problems : 

N  N 

(P  )  Minimize  4>  (u)  over  U,  where 

Au)  =  JN(zN(T;$  ,u)(0),  zN(T;<Ku),  zN(  •  ;<J>  ,u)  (0)  ,u)  , 

N 

with  z  ( -  ;4>  , u)  solution  of  (3.12)  and  with 

JN:  lRn  x  C  x  C(t0,TORn)  x  Lp(t0,T-dRm)  -  1R, 

given  by 

JN(y1,y2.y3,y4!  *  (yj-emAoytco))  *  f  ^(y2Cs)  -  (P^Ks))*H(y2Cs)  -  (pJcKs))*  I 

T 

+  [y3(s)*Qy3(s)  +  y4(s)Ry4(s)]ds 


(4.2) 
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N 

Note  that  (P  )  is  a  finite  dimensional  problem  in  the  sense  that 

it  is  equivalent  to  an  ordinary  differential  equation  optimal 

N  N 

control  problem  for  the  coefficients  w  (t)  of  z  (t).  We  shall 

N 

not  discuss  the  existence  problem  of  solutions  of  (P  )  but  rather 

refer  to  [e.g.  [17],  Chapters  4  and  5]  and  assume  that  (P^)  has 
— N 

a  solution  u  ;  if  f  is  of  the  form 

v 

f(t,<i>,u)  =  l  A  •<}>(-  r .  )  +  Eu  (4.3) 

i  =  Q  1  1 

with  e  jzfn  n ,  E  €  m  and  0  =  r^  <  ...  <  rv  =  r,  then  u^ 

N 

exists  [16]  and  since  u  -*•  <t>  (u)  is  strictly  convex  it  is  the 

N 

unique  solution  of  (P  ) . 

Theorem  4.1.  If  (H1)-(H4)  hold,  if  the  norm  on  lRn  is  chosen  such 
A 

that  l  | | B. | |  <  1  for  the  subordinate  matrix  norms  and  if 
i=l  1 

(u^)  is  a  sequence  of  optimal  controls  of  (PN)  in  the  convex  and 

closed  subset  U  of  (tn  ,T  ;IRm) ,  then  there  exists  a  subsequence 

_N,  U 

(u  K}  of  uN  which  converges  weakly  to  an  optimal  control 
u  €  U  of  (P). 

Pro£f.  For  the  ease  of  the  reader  we  shall  include  the  proof;  the 

arguments  are  quite  standard,  however.  First,  note  that  (uN)  is 

bounded  in  L  (tg,TdRm).  For  if  not,  then  there  exists  a  sub- 
_N  ^  N  z  N  N 

sequence  u  of  u  with  |u  |  ■*  »  and  therefore  <{>  ^(u 

^  A  ~>  m 

s  ♦  (v)  -*■  4>(v)  <  »  for  any  v  €  1/  (tQfTdR  ),  which  cannot  hold 

for  the  specific  J  that  was  chosen,  {u^}  being  bounded  implies 
that  it  is  weakly  compact.  Therefore,  there  exists  a  subsequence 
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-  K  -  -2m 

{u  }  of  {u  },  which  converges  weakly  to  some  u  in  L  (tQ,TpR  ). 

U  is  assumed  to  be  convex  and  closed,  which  implies  that  it  is  also 

weakly  closed  and  therefore  u  €  U.  By  the  triangle  inequality  we 

find  for  t  €  [tg,T] 

N.  N.  _N. 

I xt C •  ,u)  -  z  k(t;<J>,u  k)|  <  | xt C*  ;4>  ,u)  -  xt(.;<t>,u  )| 

_Nk  \  _Nk  (4'4) 

+  | xt ( •  ;<l>,u  k)  -  z  k(t;<l> ,u  k)|  . 

By  Lemma  2.3,  the  first  term  on  the  right  hand  side  of  (4.4)  converges 

to  0  as  K  -*•  « .  Convergence  to  zero  for  the  second  term  is  a 

consequence  of  Theorem  3.2.  In  the  following  estimate  we  use 
Nk 

u  u,  the  special  form  of  J  and  (4.4)  to  find 


<l>(u)  =  J(x(T;<l>,u),  Xj.Otf.u),  x0;4,u),u)  * 


N.  N.  N.  _N.  N,  _NL  _N. 

=  lim  J(z  k(T ;d>  ,u  k)  (0) ,  z  k(T;4>,u  k),  z  K(-;*»u  k)(0),  u  k)  = 
k+°° 

N,  N.  N,  N.  _N.  N.  _N.  _N. 

=  lim  J  k(z  K(T;<I> ,u  k) (0) ,  z  k(T;4»,u  K),  z  K(- ,u  K)(0),  u  K) 


k-*® 

=  lim  <}>  K(u  K)  <  Hi  $  k(u)  -  f(u), 
k-*°° 


for  any  u  €  U.  Therefore,  u  is  indeed  a  solution  of  (P);  moreover,  if  we 

put  u  *  u  in  the  above  inequalities  then  it  follows  that 
N.  Nk 

lim  ♦  k(u  k)  *  4>  (u* ) . 
k-*» 

It  was  pointed  out  in  (16,  Remark  4.2]  that  for  f  of  the 

_N  , 

form  (4.4)  the  stronger  result  lim  u  *  u  in  L  (tn,T^R  )  holds. 

XI  u 
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We  have  applied  Theorem  4.1  to  a  number  of  examples  of  the  type 


minimize 

T 

$(u)  =  i[x(T)*Gx(T)]  +  \  |  [x(t)*Qx(t)  ♦  u(t)*Ru(t) ]dt 

?  m  Jt° 
over  l/(t0,T;R  ) 


CP*) 


<  where  G,Q,R  are  matrices  of  appropriate  dimensions  with 
G  >  0,  Q  >  0,  R  >  0, 


-  subject  to .  -  . 

x(t)  -  Bx(t-r)  =  £(t,xt)  +  Eu(t), 


^  n  ^ 

here  f:  ]R  x  C  ]R  is  assumed  to  be  continuously  Frechet  differentiable 

/v 

in  the  second  variable  for  each  fixed  t,  t  -*•  f(t,4>t)  is  Borel 
measurable  for  each  <p  €  C(tQ-r  ,TJlRn)  and  further,  given  any  compact 
convex  set  X  c  ]Rn  there  exists  m  €  L^Ctg.TjlR1)  such  that 
|f(t,4>tdf(t,X)<H  <m(t)  and  |df(t,y>t)(-)|  <m(t)  for  each  <p  e  CCtQ-rjaR11) ; 
here  dfCt.x)^  denotes  the  Frechet  derivative  of  f  w.r.t.  the  second 
variable  evaluated  at  ijf. 

In  some  cases  we  can  calculate  analytical  solutions  to  (P*) 
using  the  maximum  principle  for  NFDE.  Since  the  latter  is  not  readily 
available  in  the  literature,  we  include  its  statement  in  a  form 
modified  to  suit  (P*)  in  Proposition  4.1.  This  is  a  special  case 
of  a  very  general  maximum  principle  for  NFDE  that  was  developed  in 
[14,  specifically  Lemma  3.3  and  Theorem  4.2);  see  also  [5]. 


Proposition  4.1.  Let 
there  exists  a  scalar 


u*  be  the  optimal  control  for  (P*).  Then 
<  0  and  a  function  »|>  €  L^  ftp  ,T+r  ^Rn) 


such  that 


7  . 
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(i)  V  (t)  =  0  on  (T,T+r] 

(ii)  =  aQGx(T)  and 

<Kt)  =  a0x(T)*G  +  ^(r+s)*B  - 

where  df(t,x.(u))  =  d  n(t,s)y(s)  for  y  €  C,  and 

j  -r 
T 

(iii)  J  [(♦(t))*Bu(t)  ♦  |«0u(t)*Ru(t)]dt  « 
t0 

T 

=  n  maX  m  f  (t) *Ev(t)  +  j  «0v(t)*Rv(t) ]dt. 
v€LP(t0;T^R  )^tQ  2  0 

A 

If  f  is  moreover  linear  in  the  second  variable  then  (i)-(iii) 
in  Proposition  4.1  guarantee  the  existence  of  a  solution  u  of 
(P*),  [14,  Theorem  5.1,  Remark  5.1]  and  (iii)  can  be  replaced  by 
the  pointwise  maximum  principle.  For 


X 

f  <Hs)*n 
J  t 


(s,t-s)ds+a0  x(s)*Qds 


f(t,tp)  =  AQ«P(0)  +  AjipC-r) 


for  example,  we  get  the  following  necessary  and  sufficient  conditions 
characterizing  u,  (without  loss  of  generality,  we  let  *  -1): 


(i)'  Ht)  =  0  .  on  (T,T+r] 

fT 

(ii)'  *(t)  -  -x(T)*G  +  «Hr+s)*B  +  J  <Ks)*A0ds  + 

T  T 

+  [  'l'(s)*A.ds  -[  x(s)*Qds 

*  t+r  1  Jt 

(iii)'  ^(t)*EuCt)  -  y  uCt)*RuCt)*  -  max  <|»Ct)*Ev 

vflRm 

for  almost  every  t  6  [tft,T]. 


\  v*Rv 
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I  From  (iii)’  it  follows  that  u(t)  *  R  ^E*ip (t )  and  we  see 

that  even  in  this  very  simple  case  ||>,  the  solution  of  ( i i )  *  and 
therefore  u  will  not  be  continuous,  in  general,  but  will  have 
!  jumps  at  all  multiples  values  of  r. 

We  shall  now  briefly  report  on  some  of  the  numerical  examples 
that  were  carried  out. 


1 


Example  1.  This  is  the  optimization  problem  of  minimizing 

J(u)  =  j  yx2(s)  +  j  |  u2(s)ds 
2 

over  L  (0,2;1R),  subject  to 

x(t)  =  j  x(t-l)  +  x(t-l)  +  u(t)  for  t  C  [0,2] 
x(t)  =  a  for  t  €  [-1,0] . 


We  used  the  maximum  principle  in  the  form  Ci) * - (iii) *  to  calculate 
the  exact  solution.  The  optimal  trajectory  x  and  optimal  control 

C  A 

u  were  found  to  be 

V  A 


xex(t)  *  <! 


t  9 

at  +  <5(^-  -  |  t)  +  1  for  t  €  [0,1] 


+ 1  (t-D3  +  ioT  t£  H,2] 


and 


uex(t)  "  1 


«Ct  '  J) 


for  t  €  (0,1] 


-6 


for 


t  €  (1,2] 


where  <5  = 


(2+Jo)Y 


For  this  and  all  the  other  examples  reported  on  in  this  section 
we  used  the  averaging  scheme  to  approximate  the  infinite  dimensional 
problem.  The  resulting  finite  dimensional  optimum  control  problem 
was  solved  via  a  combined  gradient-conjugate  gradient  iterative 
technique  and  numerical  integration  was  carried  out  by  a  modified 
Runge-Kutta  method  (Gill's  modification). 

For  this  example,  we  did  calculations  for  various  values  of  a 

and  Y.  In  Tables  1-3  the  results  for  a  =  l  and  Y  =  1  are 

presented.  As  should  be  expected  one  can  recognize  convergence  of 

optimal  state,  payoff  and  control  to  the  exact  solutions.  However, 

it  seems  quite  difficult  from  this  and  the  other  examples  that  we 

studied  on  the  computer  to  predict  a  possible  rate-of -convergence 

result.  Certainly,  the  convergence  will  be  slower  than  linear,  in 

general.  On  the  other  hand,  in  many  examples  we  experienced 

surprisingly  good  approximation  results  for  low  values  of  N.  As 

should  be  expected,  due  to  the  jumps  in  the  optimal  control  at 

N 

multiples  of  1,  the  relative  error  of  ugx  -  u  has  a  peak  at 
t  *  1.  One  can  convince  oneself  quickly  that  the  fact  that  it 
actually  increases  in  this  example  is  no  reason  for  precariousness. 


TABLE  I 
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W 


3T 


W 


xex^ 


xex"x 


xex"x 


xex'x 


xex~x 


xex"x 


x  -x 
ex 


128 


0.0 


1.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0.25 


0.8629 


0.0118 


0.0096 


0.0078 


0.0058 


0.0040 


0.0007 


1.5 


0.7713 


0.0136 


0.0077 


0.0055 


0.0039 


0.0026 


0.0017 


0.75 


0.7252 


0.0214 


0.0078 


0.0023 


0.0009 


0.0008 


0.0007 


1.0 


0.7247 


0.0484 


0.0261 


0.0136 


0.0070 


0.0035 


0.0018 


L.25 


0.7401 


0.0734 


0.0445 


0.0262 


0.0149 


0.0082 


0.0045 


1.5 


0.7384 


0.0701 


0.0384 


0.0205 


0.0112 


0.0063 


0.0000 


1.75 


0.7308 


0.0567 


0.0278 


0.0136 


0.0071 


0.0040 


0.0024 


2.0 


0.7287 


0.0506 


0.0133 


0.0070 


0.0038 


0.0021 


TABLE  II 


t 

uex(t> 

ESI 

8 

u  -u 
ex 

u  -u16 
ex 

32 

u  -u 
ex 

64 

u  -u 
ex 

128 

u  -u 
ex 

-1.6397 

0.0863 

0.0748 

0.0641 

0.0539 

0.0454 

0.0390 

0.25 

-1.4575 

0.0125 

0.0078 

0.0048 

0.0008 

-0.0023 

-0.0032 

0.5 

-1.2753 

-0.0237 

-0.0250 

-0.0195 

-0.0119 

-0.0067 

-0.0038 

0.75 

-1.0931 

-0.0268 

-0.0318 

-0.0291 

-0.0199 

-0.0098 

-0.0039 

1.0 

-0.9109 

0.0015 

-0.0130 

-0.0291 

-0.0440 

-0.0563 

-0.0658 

1.25 

-0.7287 

0.0644 

0.0469 

0.0256 

0.0082 

-0.0006 

-0.0019 

1.5 

-0.7287 

-0.0136 

-0.0138 

-0.0115 

-0.0070 

-0.0038 

-0.0021 

1.75 

-0.7287 

-0.0466 

-0.0255 

-0.0133 

-0.0070 

-0.0038 

-0.0021 

2.0 

-0.7287 

. 

-0.0506 

-0.0257 

-0.0133 

-0.0070 

-0.0038 

-0.0021 

TABLE  III 


exact 

qi 

J  -J8 
Jex  J 

•V'16 

. 

J  -J32 
ex 

J  -J64 
ex 

J  -J128 
Jex  J 

J 

1.3664 

0.0186 

0.0081 

0.0039 

0.0021 

0.0012 

0.0008 

Example  2.  This  is  another  linear  optimization  problem,  in  which 
we  try  to  minimize 


J(u)  =  \  Y  x2 (2)  +  \  |  P  u2(s)ds 
? 

over  u  €  L  (0,2;]R),  subject  to 

x(t)  *  -  \  x(t-l)  +  2x(t)  +  4u(t)  for  0  <  t  <  2 
x(t)  =  0.  "  '  for  -1  <  t  <  0. 


Again  we  used  the  maximum  principle  to  calculate  the  exact  solutions: 


xex^  =  < 


ae2t+16p'16e2(1+t)[e'4t(^  +  J  -  |g-)  ♦  fg-  '  x]  for  1  G  [0»1] 

ae2t+4P'1fe2t*2(e2  -  e6  +  -  *)  +  4r'16(e2  -  J)e2t(t-1)  -  «e2t'2(t-l) 

+  6p'1[e4~2t(^  -  t  -  e2)  +  e2t(e2  -  y)]  for  t  £  [1,2] 


4p-1«e2(1-t) 

(|  -  e2  -  t) 

for 

t  £  (0,1] 

u  ft)  -  < 

ex 

-4p‘16e4’2t 

for 

t  €  (1,2], 

where  6  •  <*(e4-e2)(Y  ^-P  ^(*4e®  ♦  lOe  -  y  e  -  2e  +  2)) 
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The  exact  and  the  numerical  values  for  the  values  A  =  4,  P  =  3 
and  y  *  1  can  be  found  in  Tables  4-6  below. 

The  numerical  solution  of  the  optimal  control  problem  requires 

an  initial  guess  for  the  optimal  control.  In  order  to  be  able  to 

compare  between  various  examples  we  always  take  as  an  initial  guess 

uQ  =  0.  In  actual  computatibns  it  will  be  advisable  to  use  the 
N  t  h 

solution  uN  of  the  approximative  step  as  start-up  value  in 
the  next  step.  The  approximation  in  Example  2,  for  instance,  -is  not 
as  good  as  in  Example  1  where  the  exact  optimal  control  is  closer 
to  0  from  t  *  0  on.  This  can  be  seen  when  comparing  the 
relative  errors  |<#>ex~^N|  /  I  ^exl  • 


xex(t) 

xex*4 

o* 

X 

1 

X 

00 

4.0000 

0.0000 

0.0000 

2.3730 

0.0247 

0.0166 

1.2449 

0.0149 

0.0313 

0.3698 

-0.1569 

-0.0642 

-0.4503 

-0.5966 

-0.4510 

-0.3738 

-0.3618 

-0.2246 

-0.3019 

-0.2629 

-0.1737 

-0.1851 

-0.1877 

-0.0514 

0.0686 

[ 

-0.0116 

-0.0058 

TABLE  IV 


x  -x16 
ex  x 


0.0000 


0.0101 


0.0219 


-0.0139 


-0.3358 


.1176 


.1095 


-0.1287 


9 


B 

B 


32 

xex"x 

64 

xex'x 

x  -x128 
ex  x 

0.0000 

0.0000 

0.0000 

0.0063 

0.0040 

0.0024 

0.0105 

0.0043 

0.0014 

0.0049 

0.0058 

0.0019 

-0.2492 

-0.1836 

-0.1342 

-0.0544 

-0.0267 

-0.0174 

-0.0725 

-0.0503 

-0.0355 

-0.1097 

-0.0974 

-0.0642 

-0.0014 

-0.0007 

-0.0003 

TABLE  V 
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t 

4 

u  -u 
ex 

8 

u  -u 
ex 

u  -u16 
ex 

u  -u32 
ex 

64 

u  -u 
ex 

v-128 

0.0 

-3.9803 

0.0119 

0.0120 

0.0122 

0.0123 

0.0122 

0.0120 

0.25 

• -2.5167 

0.0320 

0.0145 

0.0049 

-0.0001 

-0.0024 

-0.0030 

0.5 

-1.5886 

0.0398 

0.0183 

0.0067 

0.0013 

-0.0004 

-0.0009 

0.75 

-1.0012 

0.0412 

0.0222 

0.0123 

0.0063 

0.0024 

0.0004 

.  i.o  .. 

-0.6302 

0.0393 

0.0250 

0.0189 

0.0168 

0.0167 

0.0175 

1.25 

-0.4099 

0.0216 

0.0106 

0.0059 

0.0043 

0.0031 

0.0018 

1.5 

-0.2486 

0.0289 

0.0175 

0.0099 

0.0051 

0.0024 

0.0011 

1.75 

-0.1508 

0.0242 

0.0127 

0.0063 

0.0031 

0.0015 

0.0007 

2.0 

-0.0915 

0.0154 

0.0007 

0.0038 

0.0018 

0.0008 

0.0004 

TABLE  VI 


/ 

exact 

m 

J  -J8 
ex 

J  -J16 
ex 

•V'52 

J  -J64 
ex 

J  -J128 
ex 

J 

6.4798 

-0.1895 

-0.0935 

-0.0431 

-0.0177 

-0.0054 

0.0002 

Example  3.  This  finally  is  the  nonlinear  example  of  minimizing 

J(u)  -  x2(2)  +  \  [2u2(s)ds 
L  J0 

? 

over  u  E  L  (0,2;]R)  subject  to 

*(t)  *  sin  x(t)  +  x(t-l)  -  j  *(t-l)  +  u (t )  for  t  E  [0,2] 
x(t)  =4  for  t  E  [-1,0], 


The  numerical  results  of  this  example  which  are  given  in 
Tables  7-9  seem  to  support  what  could  be  seen  in  the  linear  ex¬ 
amples  already:  the  approximation  is  quite  well  for  low  values 
of  N,  and  increasing  N  does  not  improve  the  accuracy  very 
quickly. 


TABLE  VII 


4  8 

X  -x 

x8-x16 

x16-x32 

x32-x64 

x64  x128 

x128 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

-  - . 

4.0000 

0.0213 

0.0242 

0.0167 

0.0089 

0.0038 

3.8395 

0.0266 

0.0334 

0.0271 

0.0151 

0.0066 

3.7760 

0.0037 

0.0128 

0.0160 

0.0149 

0.0109 

3.8424 

-0.0378 

-0.0318 

-0.0252 

-0.0197 

-0.0153 

4,0646 

-0.0609 

-0.0476 

-0.0312 

-0.0166 

-0.0078 

4.1047 

-0.0435 

-0.0244 

-0.0143 

-0.0090 

-0.Q053 

3.9466 

-0.0158 

-0.0048 

0.0008 

-0.0009 

-Q.QQ20 

3.6203 

-0.0057 

0.0036 

0.0068 

0.0063 

0.0046 

3.1176 

9 


TABLE  VIII 


t 

4  8 
u  -u 

8  16 
u  -u 

u16-u32 

u32-u64 

u64-u128 

128 

u 

0.0 

0.0977 

0.0917 

0.0650 

0.0498 

0.0426 

-4.0700 

0.25 

0.0772 

0.0982 

0.0725 

0.0285 

0.0049 

-3.8079 

0.50 

-0.0121 

0.0103 

0.0353 

0.0412 

0.0255 

-3.4425 

0.75 

-0.1329 

-0.1392 

-0.1130 

-0.0610 

-0.0057 

-2.7341 

-  1.00 

-9.1706 

-0.1598 

—0.1369 

-0.1119 

-0.0881 

-2.4752 

1.25 

-0.0568 

0.0135 

0.0615 

0.0565 

0.0194 

-3.4442 

1.50 

0.0598 

0.0407 

0.0044 

-0.0049 

-0.0037 

-4.0264 

1.75 

0.0315 

-0.0041 

-0.0117 

-0.0106 

-0.0075 

-4.9039 

2.00 

0.0118 

-0.0067 

-0.0137 

-0.0126 

-0.0093 

-6.2344 

TABLE  IX 


00 

1 

J8-J16 

J16-J32 

J32-J64 

j64-j128 

J128 

J 

0.0348 

0.0541 

0.0545 

0.0428 

0.0302 

24.4971 

Remark  4.1.  A  series  of  examples  of  linear  and  nonlinear  unstable 
(see  Remark  3.3)  NFDE  was  also  tested  on  the  computer.  The 
numerical  results  strongly  indicate  that  the  linear  schemes  pre¬ 
sented  in  this  paper  do  converge  without  assuming  (H5) .  Unlike  in 
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Examples  1-3,  however,  for  low  values  of  N  the  numerical 
solutions  are  worthless,  their  relative  error  being  greater  than 
1  sometimes.  Increasing  N  to  256  and  higher,  however,  resulted 
in  a  surprising  increase  of  the  observed  accuracy  of  the  approxi¬ 
mation.  Although  from  a  practical  point  of  view  the  case  of 
unstable  neutral  delay  equations  is  not  as  important  as  the  stable 
one,  it  should  be  a  challenging  question  to  study  the  piecewise 
linear  schemes  presented  "without  assuming  (H5) .  Let  us  recall 
that  for  linear  NFDE  and  cubic  (or  higher-)  order  spline  schemes 
(H5)  could  be  avoided  by  working  in  state  spaces  endowed  with  a 
special  norm  depending  on  the  equation,  [9,11]. 
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